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I.  INTRODUCTION 


The  Resource  Analysis  and  Management  Systems  (RAMS)  office  of  DOD  Health  Affairs  is  developing  a  strategy 
for  resourcing  decision  support  for  ambulatory  care.  The  strategy  will  be  based  upon  an  ambulatory  care  patient 
case-mix  classification  system.  Such  a  system  would  have  far  reaching  implications  for  the  Military  Health  Care 
System,  affecting  the  collection,  reporting,  and  use  of  ambulatory  care  data. 

The  assessment  of  case-mix  classification  systems  will  consider  a  number  of  issues,  including  how  well  the 
classification  system; 

•  Encompasses  the  types  of  services  provided 

•  Accommodates  case-mbc 

•  Reflects  the  use  of  ancillary  care  personnel 

•  Reflects  the  actual  levels  of  health  resource  use 

•  Reflects  the  unique  properties  of  the  military  health  care  system 

This  study  will  explore  these  and  other  issues  pertinent  to  some  of  the  better  developed  ambulatory  patient 
cla.ssification  systems  using  available  data  sources.  This  report  assesses  the  adequacy  of  the  available  data 
sources  for  the  resolution  of  the  study  issues. 

1.  PURPOSE  OF  THE  STUDY 

As  noted  above,  this  task  is  part  of  a  larger  effort  that  seeks  to  address  the  global  issues  described  above.  The 
purpose  of  the  present  effort  is  to  establish  the  usefulness  of  the  three  data  bases  in  the  support  of  project 
activities.  These  data  bases  are  the: 

•  Uniformed  Services  Treatment  Facility  (USTF)  Data  Base 

•  Civilian  Health  And  Medical  Program  of  The  Uniformed  Services  (CHAMPUS)  Data  Base 

•  U.S.  Army  Ambulatory  Care  Data  Base  (ACDB) 

Project  activities  in  which  these  data  bases  are  to  be  employed  include: 

•  Evaluation  of  alternative  resourcing  systems  (Resource-Based  Relative  Value  (RBRVS), 
Ambulatory  Work  Units  (AWU),  etc.) 

•  Definition  of  episodes  of  illness  for  selected  diseases 

•  Comparative  analysis  of  differences  in  case-mix  and  service  utilization  between  the  civilian  and 
military  populations 

•  Assessment  of  the  statistical  and  clinical  adequacy  of  the  AVG  (Ambulatory  Visit  Groups)  and 
the  APG  (Ambulatory  Patient  Groups)  grouping  methodologies 
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•  Determination  of  the  types  of  data  that  should  be  collected  as  part  of  the  Standardized 
Ambulatory  Data  Record  (SADR)  and  related  DOD  health  information  systems  to  support 
ambulatory  case-mix  assessments 

The  usefulness  of  these  data  bases  will  be  gauged  by  a  number  of  dimensions  that  include: 

•  Sufficient  data  elements 

•  Patient  demographics 

•  Level  of  reporting 

•  Number  of  observations 

•  Time  period 

•  Quality 

In  addition  to  an  exploratory  analysis  that  considers  the  properties  of  the  data,  we  will  also  use  the  data  to 
provide  a  preliminary  description  of  the  patient  population,  case-mix,  and  service  utilization  patterns. 

2.  DESCRIPTION  OF  THIS  REPORT 

This  report  is  organized  into  seven  brief  chapters  that  include  this  introduction.  Much  of  the  discussion  is 
dedicated  to  describing  the  patient  population  and  its  associated  case-mix.  Other  discussions  review  the  types 
of  problems  encountered  in  using  the  data  and  how  these  problems  affect  their  utility  for  subsequent  analyses 
of  the  types  described  above.  Tl^  report  concludes  with  recommendations  regarding  the  most  appropriate  use 
for  each  of  these  data  bases. 
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11.  METHODOLOGY 


This  discussion  provides  some  general  background  regarding  the  three  data  bases  examined  in  this  study.  This 
background  includes  information  on  the  health  care  system  that  generates  the  data,  the  reason  for  data  collection, 
the  types  of  data  collected,  data  processing  and  editing  activities,  and  the  content  of  the  data  bases  that  serve 
as  the  working  files  for  this  effort. 

1.  DESCRIPTION  OF  THREE  STUDY  DATA  BASES 

Three  data  btises  with  some  relevance  to  the  military  were  provided  for  use  in  the  present  study.  These  data 
bases  were: 

•  Uniformed  Services  Treatment  Facilities  (USTF)  Data  Base 

•  Civilian  Health  and  Medical  Program  of  the  Uniformed  Services  (CHAMPUS)  Data  Base 

•  U.S.  Army  Ambulatory  Care  Data  Base  (ACDB) 

The  structure  and  content  of  each  of  these  data  bases  is  described  below. 

(1)  Uniformed  Services  Treatment  Facilities  (USTF)  Data  Base 

The  Military  Construction  Act  of  1982  authorized  10  former  Public  Health  Service  hospitals  and  clinics  to  provide 
free  comprehensive  health  care  services  to  eligible  beneficiaries  of  the  Armed  Forces,  the  Coast  Guard,  the 
Commissioned  Corps  of  the  Public  Health  Service,  the  National  Oceanic  and  Atmospheric  Administration 
(NOAA),  and  lighthouse  keepers.  Eligible  beneficiaries  include  active-duty  personnel,  their  dependents,  retirees 
and  their  dependents,  and  survivors. 

The  USTF  functions  similarly  to  a  capitated  health  care  system.  Reimbursement  is  based  upon  the  first  annual 
visit  of  a  beneficiary. 

The  USTF  Data  Base  ensures  appropriate  reimbursement  for  “member"  beneficiaries  and  also  documents 
patterns  in  health  services  utilization.  Each  facility  continuously  collects  data  on  inpatient  admissions  and 
ambulatory  visits  that  are  submitted  on  a  monthly  basis  to  a  contractor.  Vector  Research,  Inc.,  for  edit 
processing.  At  year-end,  all  corrected  monthly  data  from  all  USTFs  are  processed  to  create  the  annual  USTF 
data  base. 

Each  data  base  record  includes  the  following  data: 

•  Characteristics  of  the  facility,  patient,  sponsoring  beneficiary,  and  provider 

•  Inpatient  admission,  discharge,  patient  status,  diagnoses,  procedures,  and  third  party 
reimbursement  (where  applicable) 

•  Outpatient  services  by  date  of  service,  procedure,  and  associated  diagnosis  (up  to  six) 

Any  individual  data  base  record  can  contain  data  on  more  than  one  outpatient  encounter. 
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The  monthly  data  tape  from  each  facility  must  pass  a  series  of  edits  and  may  be  returned  to  the  facility  for 
reprocessing  if  it  is  below  an  established  standard.  The  edits  only  inspect  data  fields  for  prima  facie  errors  (e.g., 
digit  check  to  find  nonnumeric  characters  in  numeric  fields,  etc.)  and  not  contextual  errors  based  upon  the 
interrelationships  of  different  fields. 

Our  working  data  base  includes  762,752  inpatient  and  ambulatory  care  records.  Most,  86  percent,  of  the  records 
on  the  data  base  are  for  1988,  another  13  percent  are  from  1987,  and  the  rest  are  from  other  years  and  cU'e 
possibly  miscodes. 

(2)  Civilian  Health  and  Medical  Program  of  the  Uniformed  Services  (CHAMPUS)  Data  Base 

The  Department  of  Defense’s  CHAMPUS  program  provides  civilian  health  services  to  its  beneficiaries,  as 
opposed  to  treatment  provided  through  the  military  or  uniformed  services  MTFs. 

The  purpose  of  the  CHAMPUS  data  base  and  associated  ADP  system  is  to  provide  an  automated  means  of 
processing  CHAMPUS  claims  to  completion  on  a  timely  basis,  and  to  be  the  repository  of  related  records.  Data 
are  collected  continuously  by  various  Fiscal  Intermediaries  (FIs),  and  then  sent  to  CHAMPUS  for  consolidation. 

Each  record  represents  a  claim,  a  partial  claim,  or  a  correction/modification  of  a  previously  submitted  claim. 
The  records  contain  variables  associated  with: 

•  Claim  identification 

•  Finance  and  payment 

•  Hospital/clinic  encounter  characteristics 

•  Sponsor  and  patient  demographic  characteristics 

•  Health  care  provider  characteristics 

The  claim  ID,  financial  data  (including  diagnosis),  and  sponsor  and  patient  demographic  variables  occur  once 
per  record,  and  is  referred  to  as  the  "header".  The  hospital/clinic  encounter  variables  and  health  care  provider 
variables,  may  occur  0  to  32  times  per  record,  and  include  the  health  service  procedure  codes.  These  variables 
are  referred  to  as  the  "detail  records"  of  the  claim  record. 

The  records  made  available  for  analysis  contain  only  the  professional  services  claims  (record  type  seven) 
submitted  during  1987  (90  percent)  and  1988  (10  percent).  These  claims  may  represent  either  inpatient  or 
outpatient  charges  for  a  given  record.  Whether  they  are  inpatient  or  outpatient  claims,  they  may  also  include 
drug  charges. 

(3)  U.S.  Army  Ambulatory  Care  Data  Base  (ACDB) 

The  ACDB  was  developed  under  the  auspices  of  the  U.  S.  Army  (USA)  Medical  Department  (AMEDD). 
Envisioned  as  part  of  the  AMEDD  Performance  Measurement  Study  (PMS),  this  effort  was  ultimately  subsumed 
under  the  DOD  Tri-Service  Performance  Measurement  Study  in  1986.  The  focus  of  this  effort  was  on  the 
creation  of  a  decentralized  and  automated  system  for  collecting  ambulatory  care  data  that  are  relevant  to  clinical 
practice  and  research. 

The  ACDB  consists  of  outpatient  data  in  over  70  clinical  specialties  at  six  USA  medical  treatment  facilities 
(MTF)  and  spans  a  period  from  January  1986  through  September  1987.  The  core  data  base  contains  data  on: 
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•  Patient  characteristics-includes  date  of  birth,  sex,  race/ethnicity,  eligibility  status 

•  Outpatient  visit  characteristics-includes  visit  date,  diagnoses,  procedures,  disposition,  place 
of  visit,  new/old  patient,  provider,  and  provider  time 

•  Provider  characteristics-includes  provider  type,  specialty,  military  service,  position,  and  status 
(permanent/other) 

The  ACDB  was  originally  structmed  in  a  hierarchical  data  base  management  systen  called  FOCUS.  The  data 
were  later  restructured  into  sequential  files  where  each  record  contained  data  associated  with  a  specific  patient 
visit. 

Data  were  collected  on  3,108,741  patient  encounters.  The  data  base  used  for  this  feasibility  assessment  is  based 
on  a  universe  of  inquiry  of  approximately  2.7  million  records  that  were  collected  through  April  30,  1987.  After 
this  date,  data  collection  form  revisions  were  instituted.  The  data  base  was  subjected  to  extensive  edits  and  the 
resultant  "cleaned”  data  base  consisted  of  approximately  1.1  million  records.  A  "split  halT  of  this  data  base, 
consisting  of  516,006  encounters,  was  used  in  the  feasibility  assessment. 

2.  ASSESSMENT  METHODOLOGY 

The  assessment  considered  the  utility  of  the  data  for  describing  the  patient  population  and  its  associated  case- 
mix/utilization  patterns.  To  make  the  analysis  manageable,  we  have  focused  on  a  few  key  variables  that  support 
the  types  of  case-mix  analyses  planned  for  this  study.  These  variables  are; 

•  Patient  age 

•  Patient  sex 

•  Patient  ID 

•  Patient  military  service  branch 

•  Patient  duty  status 

•  Service  facility 

•  Provider  ID 

•  Diagnoses 

•  Service  procedures 

•  Dates  of  service 

•  Type  of  service  (ambulatory  or  inpatient) 

The  first  step  of  the  assessment  entailed  close  examination  of  the  characteristics  of  each  of  the  study  variables. 
These  characteristics  included: 
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•  Frequency  distribution 

•  Measures  of  central  tendency  (where  appropriate) 

•  Range  and  variance 

•  Missing  values 

•  Improper  or  incorrect  codes 

In  developing  a  subset  of  data  suitable  for  study,  we  also  deleted  selected  records  because  they  had  one  or  more 
of  the  following  properties: 

•  Represented  inpatient  encounters 

•  Patient  was  not  an  eligible  beneficiary 

•  No  reported  diagnoses 

•  If  date  of  birth  was  missing  or  later  than  the  data  year 

•  Patient  sex  was  missing 

The  analysis  assessed  the  potential  biases  associated  with  exclusion  of  these  records. 

Once  we  had  arrived  at  a  suitable  study  file,  we  used  the  data  to  both  describe  the  demographic  and  service 
characteristics  of  the  respective  patient  populations  as  well  as  the  associated  case-mix/utilization  patterns. 

Lessons  learned  from  efforts  to  use  the  data  were  applied  to  an  examination  of  issues  that  affect  the  application 
of  data  bases  in  other  project  activities,  specifically. 

•  Scope  of  the  data 

•  Data  structure 

•  Completeness  and  accuracy 

•  Time  series 

•  Relevance  to  the  military 
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III.  PROPERTIES  OF  THE  DATA 


The  following  discussion  addresses  two  general  categories  of  problems  that  are  associated  with  the  data;  (1) 
missing  and  erroneous  data  and  (2)  potential  biases  associated  with  excluding  erroneous  data  from  the  data  base. 
Each  problem  is  analyzed  in  a  separate  section  below. 

1.  MISSING  AND  ERRONEOUS  DATA 

The  following  discussion  address  the  problems  associated  with  missing  and  incorrect  data  in  the  three  target  data 
bases.  A  separate  discussion  is  devoted  to  each  data  base.  The  focus  is  on  the  adequacy  of  diagnostic  and 
procedural  codes  that  are  critical  to  the  grouping  of  ambulatory  visits. 

(1)  Uniformed  Services  Treatment  Faciiities  (USTF)  Data  Base 

In  the  assessment  of  missing  data,  we  focused  on  the  basic  data  elements  that  vtill  be  used  to  group  the  data, 
especially  patient  age  and  sex,  procedure  codes,  and  diagnostic  codes.  Initial  analyses  of  the  data  file  determined 
14.5  percent  of  the  records  were  incomplete  with  respect  to  these  variables.  Missing  diagnostic  codes  were  the 
major  symptom  of  this  problem. 

Even  when  diagnostic  data  were  available,  the  coding  was  haphazard.  Diagnostic  codes  should  have  a  maximum 
length  of  six  characters  including  a  decimal  point  and  be  left-justified  with  leading  zeroes.  There  were  frequent 
departures  from  this  model  in  the  USTF,  including; 

•  Erratic  inclusion  of  the  decimal  point 

•  Incorrect  placement  of  the  decimal  point 

•  Imbedded  blanks 

•  Leading  blanks 

•  Invalid  lead  alpha  characters  (A,  B,  C,  Z,  OV) 

•  All  zeroes 

•  Fourth  and  fifth  digits  missing  when  required 

A  SAS  macro  was  developed  for  correcting  these  problems  where  possible. 

Procedural  coding  also  showed  inconsistencies  and  inaccuracies.  Initial  analyses  suggest  that  approximately  19 
percent  of  the  procedure  codes  were  invalid  and  out  of  conformance  with  CFT  standards.  The  following  six 
nonstandard  codes  were  used  with  considerable  frequency; 

•  00000~No  Recorded  Diagnosis 

•  90095“Data  Entry  Error 

•  99500-DoD  Clinic  Visit 

•  99501“Clinic  Count  (Different  from  clinic  visit) 

•  99520-Outpatient  Service  With  No  Charge 

•  99999"Nonpatient  Pre-  Or  Post-operative  Examination 
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Civilian  Health  and  Medical  Program  of  the  Uniformed  Services  (CHAMPUS)  Data  Base 


While  analyzing  this  data  base,  we  focused  on  the  development  of  an  approach  to  convert  these  data  from 
individual  claims  to  a  record  unit  that  represents  an  individual  encounter. 

A  hinderance  to  developing  this  approach  was  the  lack  of  documentation  detailing  how  a  "correct’  claim  record 
should  have  been  input  and  formatted.  Partial  documentation  has  recently  become  available  and  has  helped  in 
determining  which  claim  records  and  associated  detail  records  (containing  procedure  codes  and  visit  counts) 
needed  to  be  extracted  and  reformatted  to  create  an  ambulatory  encounter  based  record. 

Missing  values  for  data  fields  in  the  claim  records  do  not  appear  to  be  a  problem.  Additionally,  the  quality  of 
the  diagnosis  and  procedure  coding  (i.e.  valid  coding)  is  very  good,  which  one  expects  from  a  claims  data  base. 
However,  knowledgeable  individuals  have  cautioned  that  the  appropriateness  of  the  diagnosis  on  CHAMPUS 
records  may  be  questionable  because  the  payment  or  claim  completion  does  not  rely  on  an  accurate  diagnosis. 

Claim  records  identified  as  a  Fiscal  Intermediary  (FI)  denied  claim,  a  CHAMPUS  denied  claim,  a  fraudulent 
claim,  a  duplicate  claim  or  erroneous  claim  due  to  an  R  error  will  be  removed  from  the  consideration  of  this 
study.  Claim  records  that  are  resubmitted  for  adjustments  will  be  included  so  that  adjusted  procedure  service 
counts  and  billings  may  be  included  on  the  final  encounter  record. 

Valid  claim  records  that  have  procedures  that  have  been  denied  will  have  these  procedures  deleted.  Reasons 
for  the  procedure  denials  include  instances  where  there  have  been  duplicate  billings  (excluded  for  coordination 
of  benefits),  the  claimant  was  not  eligible,  the  service  was  not  a  covered  benefit,  other  insurance  paid  in  full,  the 
filing  limitation  was  exceeded,  the  DEERS  reply  was  negative,  or  for  other  reasons  (coded  as  "other*  denial  but 
not  clearly  defined  by  the  available  CHAMPUS  manuals. 

Individual  encounters  often  have  incorrect  or  "time  period’  dates  listed  rather  than  an  actual  date  of  service,  and 
there  is  a  lack  of  uniformity  in  "episode"  billing  by  the  Rs.  Additionally,  any  claimant  in  the  CHAMPUS  data 
base  could  feasibly  receive  treatment  for  a  segment  of  an  episode  of  illness  from  other  health  systems  (i.e. 
MTFs).  These  observations  noted  above  indicate  that  the  data  available  in  this  data  base  would  be  of  little  use 
for  researching  episodes  of  illness. 

(3)  UJS.  Army  Ambulatory  Care  Data  Base  (ACDB) 

In  exploring  the  characteristics  of  unduplicated  patients  in  the  ACDB  file,  we  found  the  file  to  be  virtually 
complete  in  terms  of  age  and  sex 

Diagnostic  coding  is  complete.  Coding  parallels  the  ICD-9-CM  with  the  addition  of  107  "S’  codes  that  represent 
psychosocial  problems,  llie  most  ft'equently  cited  diagnosis,  V6S.S,  represents  a  "person  with  feared  complaint 
in  whom  no  diagnosis  is  made."  It  has  been  noted  elsewhere^  that  this  diagnosis  may  have  been  misused  and 
became  a  catchall  category  when  a  more  suitable  diagnosis  could  not  be  readily  located. 

The  ACDB  study  included  a  "rule  out"  field  to  give  practitioners  added  flexibility  in  assigning  diagnoses.  This 
field  was  completed  for  only  4  percent  of  the  data  base  encounters  and  resulted  in  the  addition  of  only  two 
diagnoses  to  the  ISO  most  frequent  diagnoses  in  the  file.  The  added  diagnoses  were  "rule  out  multiple  sclerosis’ 
and  "rule  out  person  with  feared  complaint  in  whom  no  diagnosis  is  made." 

Extensive  use  of  nonstandard  procedure  codes  was  made  in  the  ACDB  to  accommodate  the  unique  aspects  of 
health  care  services  provided  in  the  military.  Twenty  of  the  25  most  frequently  reported  procedures  were  based 
upon  these  nonstandard  codes.  An  extensive  cross-walk  effort  would  have  to  be  undertaken  to  bring  this  coding 
in  line  with  CPT-4  standards. 
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the  U.S.  Public  Health  Service. 


The  biggest  problem  encountered  with  this  file  in  terms  of  missing  data  relates  to  excluded  fields.  The  ACDB 
Data  Dictionary  documents  73  data  elements  in  the  ACDB  file.  For  this  effort,  we  had  access  to  26  of  these 
elements.  While  some  of  the  missing  data  elements  were  tangential  to  the  purposes  of  the  current  study,  some 
of  the  more  significant  exclusions  were; 

•  New/old  patient 

•  Place  of  visit 

•  Patient  disposition 

•  Patient  military  service  category 

•  Patient  race/ethnicity 

•  Provider  position 

2.  POTENTIAL  BIASES  ASSOCIATED  WITH  RECORD  EXCLUSION 

A  number  of  records  from  all  three  data  bases  have  either  been  removed  or  will  be  removed  due  to  incorrect 
or  missing  data  in  critical  fields  or  because  they  are  otherwise  out-of-scope,  representing,  for  example,  inpatient 
care  or  a  beneficiary  group  that  is  of  low  relevance  to  the  military.  These  exclusions  are  likely  to  be  random 
and  not  affect  the  underlying  population  from  which  the  data  arise.  However,  it  is  important  to  determine  if  this 
is,  in  fact,  the  case  and  whether  adjustments  must  ultimately  be  made  to  the  data. 

(1)  Uniformed  Services  Treatment  Facilities  (USTF)  Data  Base 

It  is  important  to  note  that  all  inpatient  records  were  excluded  before  any  of  the  following  analysis  of  excluded 
or  included  records  was  performed.  Furthermore,  all  ensuing  demographic  analyses  are  based  upon  unduplicated 
patient  records.  Exhibit  III-l  compares  differences  between  included  and  excluded  patients  in  terms  of  selected 
demographic  characteristics. 

For  this  preliminary  analysis,  all  patient  records  that  were  missing  diagnosis,  sex,  and  date  of  birth  were  excluded 
from  the  study.  We  further  eliminated  individuals  serving  outside  of  the  military  or  Public  Health  Service  and 
individuals  bom  before  1880  or  after  1988  (assuming  that  the  date  of  birth  was  entered  in  error).  Further, 
records  were  excluded  before  unduplicating  the  demographic  data  files  upon  which  the  bias  analysis  is  based. 
Since  the  file  contains  multiple  records  per  patient,  it  is  possible  that  a  patient  may  appear  in  both  included  and 
excluded  groups.  This  lack  of  independence  may  dampen  the  differences  observed  between  the  two  groups. 

In  assessing  potential  biases  we  chose  to  look  at  four  patient  characteristics:  (1)  age,  (2)  sex,  (3)  service 
affiliation,  and  (4)  relationship  to  sponsor  (primary  beneficiary).  Results  of  this  assessment  are  as  follows: 

•  Age-Distributional  differences  rarely  exceed  two  percentage  points  in  any  group.  The  only 
exceptions  are  in  older  groups,  i.e.,  patients  aged  50-59  and  65  and  over  where  the  differences 
approached  five  percent. 

•  Scz-The  observed  differences  were  modest.  Of  the  excluded  patients,  45  J  percent  were  male 
compared  to  47.6  percent  among  the  included. 
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•  Service  AflUiation—Strong  simUarities  exist  in  tenns  of  service  affiliation.  Exclusions  showed 
somewhat  higher  representation  by  the  Army  (40.8  percent  versus  34.1),  and  a  somewhat  lower 
representation  by  patients  in  the  Navy  (21.4  percent  versus  27.0  percent)  and  the  Coast  Guard 
(7.7  percent  versus  10.5  percent). 

•  Relation  to  the  Sponsor— In  terms  of  sponsorship,  the  only  notable  difference  was  that  the 
inclusions  were  more  likely  to  be  patients  who  were  the  sponsor  (34.7  percent  versus  28.8 
percent). 

In  summation,  there  is  little  evidence  to  suggest  that  significant  biases  are  associated  with  dropping  selected 
records  from  the  file. 

(2)  Civilian  Health  and  Medical  Program  of  the  Uniformed  Services  (CHAMPUS)  Data  Base 

The  principal  issue  associated  with  the  CHAMPUS  data  is  the  generation  of  visit-level  records.  The  creation 
of  such  a  file  may  entail  removal  of  records  from  the  claims  data  base  that  lack  sufficient  data  for  regrouping. 
We  will  conduct  a  bias  assessment  of  these  exclusions  once  the  file  conversion  algorithm  has  been  implemented. 

(3)  U^.  Army  Ambulatory  Care  Data  Base  (ACDB) 

As  noted  earlier,  in  cleaning  the  ACDB,  incomplete  records  were  dropped  from  the  file.  The  cleaned  data  base 
includes  1.1  million  of  2.7  million  records  that  were  collected  through  April  30,  1987.  The  version  of  the  data 
base  that  was  provided  to  B&D  represents  a  "split  halT  of  the  cleaned  data  base  containing  516,006  visit  records. 
Such  a  dramatic  loss  of  records  introduces  the  potential  for  significant  bias. 
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IV.  CHARACTERISTICS  OF  PATIENTS  SELECTED  FOR  STUDY 


The  following  discussion  explores  the  attributes  of  the  patient  underlying  patient  populations  for  the  three  data 
bases.  Available  demographic  data  are  limited,  so  the  discussion  focuses  on  age,  sex,  service  branch/affiliation, 
and  relationship  of  the  patient  to  the  primary  beneficiary.  Exhibit  IV-1  displays  selected  demographic  data  for 
all  three  data  bases. 

1.  UNIFORMED  SERVICES  TREATMENT  FACILITIES  (USTF)  DATA  BASE 

All  of  the  following  statistics  are  based  upon  unduplicated  patient  counts.  Data  on  age  and  sex  are  reported  by 
facility  in  Exhibit  IV-2.  Other  data  on  service  branch  and  the  relationship  of  the  patient  to  the  primary 
beneficiary  are  also  shown  by  facility  in  Exhibit  IV-3. 

•  Age-Overall,  21.8  percent  of  the  patients  are  aged  under  20  years  old  and  another  16.6  percent 
are  65  years  and  older.  More  than  half  of  this  population  is  aged  40  years  and  older. 

In  terms  of  facility-specific  characteristics,  Staten  Island  has  the  lowest  percentage  of  patients 
under  20  years  old,  8.6  percent,  as  well  as  one  of  the  highest  percentages  of  patients  65  and 
over  years  old,  21.9  percent.  This  same  tendency  was  noted  for  Boston  (13.0  percent  young  and 
25.1  percent  old)  and  Seattle  (16.0  percent  young  and  27.1  percent  old).  In  terms  of  overall 
numbers,  Seattle  was  responsible  for  treating  approximately  25  percent  of  the  29,447  USTF 
patients  in  the  oldest  age  category.  Cleveland  and  Galveston,  on  the  other  hand,  appeared  to 
treat  relatively  more  patients  in  the  younger  (under  20  years  old)  age  groups,  25.7  and  283 
percent  respectively.  This  tendency  was  observed  for  aU  groups  under  40  years  of  age. 

Nassau  Bay  and  Portland  are  remarkable  for  the  large  numbers  of  infants  that  they  treat. 
These  two  facilities  were  responsible  for  48  percent  of  the  2,296  infants  treated  by  USTFs. 

•  Sex-Overall,  52.4  percent  of  all  patients  were  female  and  47.6  percent  were  male.  There  is 
some  variation  by  facility.  A  relatively  high  proportion  of  patients  in  Baltimore  are  female  (59.4 
percent).  Males  represented  the  largest  patient  group  in  half  of  the  facilities:  Portland  (50.4 
percent),  Boston  (54.9  percent),  Staten  Island  (53.7  percent),  Cleveland  (54.9  percent),  and 
Galveston  (50.4  percent). 

•  Service  Branch-The  U.S.  Army  represented  approximately  one-third  of  the  USTF  patients  and, 
thus,  was  the  largest  single  patient  group.  The  Navy  accounted  for  another  27.0  percent,  and 
the  Air  Force,  22.7  percent.  These  three  services  accounted  for  over  80  percent  of  the  observed 
patient  population. 

•  Relation  to  the  Primary  Beneficiary-The  primary  beneficiary  was  the  sponsor  in  35.1  percent 
of  this  unduplicated  study  population.  Spouses  represented  the  second  largest  group  at  34.7 
percent.  Children  of  the  sponsor  represented  19.1  percent  of  the  patients.  Sponsor  status  was 
unknown  for  11  percent  of  patients. 

Boston,  Staten  Island,  and  Cleveland  all  reported  nearly  half  of  their  patients  to  be  the  sponsor. 
Children  represented  at  least  one  quarter  of  the  patients  in  Nassau  Bay,  Houston,  and 
Galveston. 
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2. 


CHAMPUS 


The  demographic  data  reported  in  Exhibit  IV- 1  represent  an  unduplicated  CHAMPUS  patient  population.  The 
major  attributes  of  this  patient  population  are  discussed  below: 

•  Sex-Of  the  total  unduplicated  patient  records  (1.2  million),  34.S  percent  are  male  and  65.5 
percent  are  female. 

•  Age-Less  than  one  percent  of  ihe  records  represent  patients  65  years  old  or  older  who  are 
ineligible  for  CHAMPUS  services.  Overall,  the  age  distribution  seems  smoother  than  that 
observed  for  the  other  study  patient  populations,  with  a  slight  preponderance  in  the  younger 
age  groups.  Thirty-seven  percent  of  the  patients  are  aged  under  20  years,  34  percent  between 
the  ages  of  20  and  49,  and  the  remainder  in  the  oldest  age  groups. 

•  Service  Branch— The  Navy  and  Marine  Corps  sponsors  together  consist  of  42.2  percent  of  the 
records,  the  Army  29.1  percent,  and  the  Air  Force  25.8  percent. 

Active  duty  personnel  are  not  eligible  to  be  CHAMPUS  beneficiaries.  Those  records 
designated  as  "selT  are  retirees  who  have  not  reached  65  years  old  and,  thus,  are  not  Medicare 
eligible. 

3.  U.S.  ARMY  AMBULATORY  CARE  DATA  BASE  (ACDB) 

We  were  limited  by  the  availability  of  specific  data  elements  to  thoroughly  pursue  the  characteristics  of  this 
patient  population.  Our  findings  pertinent  to  age  and  sex,  by  reporting  facility  (see  Exhibit  IV-4),  are  as  follows: 

•  Age-  •Most  of  the  service  population  of  these  facilities  is  young.  Overall,  31.7  percent  are 
younger  than  20  years  old  and  64.4  percent  fall  between  ages  20  and  64  years  old.  Only  3.9 
percent  are  65  plus  years  of  age.  This  population  is  much  younger  than  that  reported  in  the 
USTF,  with  only  22  percent  aged  40  or  more  years. 

The  observed  age  distribution  varies  dramatically  by  facility.  Ft.  Sam  Houston,  for  example, 
has  a  high  percentage  of  patients  in  the  oldest  group  (9.1  percent  65  years  old  or  older).  Ft. 
Jackson  and  the  Redstone  Arsenal  treat  relatively  high  proportions  of  pati-nts  who  are  under 
20  years  old  (40.1  and  36.3  percent  respectively).  Ft.  Jackson  is  remarkable  for  the  very  high 
proportion  of  its  patients  who  are  aged  between  15  and  29  (67  percent  compared  to  46  percent 
overall). 

•  Sex— The  service  population  is,  overall,  predominantly  male  (56.7  percent).  This  preponderance 
is  consistent  across  facilities  and  is  especially  large  at  Ft.  Polk  where  males  represent  60.3 
percent  of  the  service  population. 


IV-2 


EXHIBIT  lV-4 

NUMBER  AND  PERCENT  DISTRIBUTION  OF  PATIENTS 
BY  AGE.  SEX.  AND  FACILITY 
U.S.  ARMY  AMBULATORY  CARE  DATA  BASE 


CHAPTER  V 


CASE-MIX  AND  ILLNESS  EPISODE  DURATIONS 


V.  CASE-MIX  AND  ILLNESS  EPISODE  DURATIONS 


Case-mix  was  examined  in  tenns  of  both  diagnosis  and  the  provision  of  health  services.  The  following  discussion 
represents  preliminary  efforts  at  characterizing  these  important  attributes  of  the  service  population  suggests  that 
such  analyses  are  both  feasible  and  valid.  An  examination  of  time  intervals  between  visits  and  the  time  span  of 
patient  records  suggests  that  there  may  be  problems  with  the  data  in  analyzing  episodes  of  illness.  As  in  prior 
discussions,  each  data  base  is  considered  separately. 

1.  ANALYSIS  OF  DIAGNOSTIC  CASE-MIX 

Diagnostic  case-mix  is  an  essential  element  of  health  care  resourcing  activities.  Presumably,  if  one  knows  the 
distribution  of  illness  within  the  service  population,  then  resources  can  be  planned  based  upon  the  amount  and 
types  of  care  generally  provided  for  these  illnesses. 

(1)  Uniformed  Services  Treatment  Facilities  (USTF)  Data  Base 

USTF  case-mix  data  are  summarized  for  the  top  46  diapioses  in  Exhibit  V-1.  Fifty  percent  of  total  reported 
diagnoses  were  represented  by  only  46  diagnoses.  Of  these  diagnoses,  nearly  half  (49  percent)  were  classified 
with  "V  codes  which  are  used  when  someone  who  is  not  sick  receives  health  services  for  a  specific  purpose 
(exam)  or  when  circumstances  or  a  problem  is  present  that  influences  the  person’s  health  status,  but  does  not 
represent  a  current  illness.  The  code  should  only  be  used  as  a  supplementary  code.  Those  "V  codes  which 
ranked  among  the  top  ten  diagnoses  included: 

•  Other  counseling,  not  elsewhere  classified  (V65.4) 

•  Laboratory  examination  (V72.6) 

•  Radiological  examination  (V72.5) 

•  Routine  general  medical  examination  at  a  health  care  facility  (V70.0) 

•  Gynecological  examination  (V723) 

Most  of  the  medical  diagnoses  found  within  the  top  SO  percent  were  for  acute  conditions.  The  leading  medical 
diagnosis  was  for  essential  hypertension,  unspecified  (401.9).  Other  medical  diagnoses  in  the  top  ten  include: 

•  Allergic  rhinitis,  cause  unspecified  (477.9) 

•  Diabetes  mellitus,  adult  onset  or  unspecified  as  to  type  (250.00) 

•  Otitis  media,  unspecified  (382.9) 

This  latter  diagnosis  was  confined  largely  to  children.  It  should  be  noted  that  one  of  the  top  ten  diagnoses, 
"00000,"  was  erroneous. 

Case-mix  differences  represented  by  the  top  five  diagnoses  in  each  facility  are  shown  in  Exhibit  V-2.  As  shown 
by  this  exhibit,  there  is  a  wide  variation  between  facilities  in  terms  of  predominant  conditions.  Those  conditions 
that  were  among  the  top  five  for  at  least  three  facilities  were  as  follows: 
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•  Essential  hypertension  (401.9) 

•  Routine  general  medical  examination  (V70.0) 

•  Allergic  rhinitis  (477.9) 

•  Gynecological  examination  (V72.3) 

•  Otitis  media,  unspecified  (382.9) 

•  Routine  infant  or  child  care  (V20.2) 

Essential  hypertension  was  either  the  first  or  second  most  common  diagnosis  in  six  of  the  12  facilities.  Half  of 
these  six  diagnoses  were  medical.  Only  the  diagnosis  ‘routine  infant  or  child  care*  failed  to  show  up  among  the 
overall  top  10  USTF  diagnoses.  It  is  interesting  to  note  that  the  last  two  of  these  diagnoses  relate  specifically 
to  child  care. 

(2)  Civilian  Health  and  Medical  Program  of  the  Uniformed  Services  (CHAMPUS) 

The  number  and  percent  distribution  of  the  top  50  diagnoses  for  the  CHAMPUS  patient  population  are  shown 
in  Exhibit  V-3.  Fifty  percent  of  all  diagnoses  are  represented  by  this  list. 

The  types  of  diagnoses  encountered  differ  markedly  from  those  described  for  the  two  other  patient  populations. 
The  distribution  of  illnesses  is  both  more  chronic  and  more  serious.  Only  one  *V*  code  appears  in  this  group. 

Twenty-five  percent  of  all  diagnoses  were  represented  by  the  top  10  diagnoses  on  this  list.  Two  of  these 
diagnoses  relate  to  children  (382,9  and  V20.2),  three  to  psychiatric  problems  (300.4, 309.2,  and  300.0),  and  three 
to  relatively  mild  and  probably  acute  conditions  (477.9,  46.2,  and  465.9).  The  remaining  problems  (401.9  and 
493.9)  are  clearly  chronic  and  generally  associated  with  adult  patients. 

Given  the  absence  of  the  elderly  from  the  CHAMPUS  population,  it  is  difficult  to  believe  that  this  population 
IS  so  much  more  severely  and  chronically  ill  than  patients  in  the  other  two  populations.  It  is  hypothesized  that 
while  Military  Treatment  Facilities  represent  the  chief  source  of  routine  and  preventive  care  for  this  population, 
CHAMPUS  may  be  used  more  often  to  address  the  more  serious  and  potentially  debilitating  conditions. 

(3)  U,S.  Army  Ambulatory  Care  Data  Base  (ACDB) 

Similar  to  the  case  for  the  USTF  data  base,  50  percent  of  total  reported  ambulatory  care  diagnoses  were 
accounted  for  by  only  50  diagnoses  (see  Exhibit  V-4).  The  'V  codes  accounted  for  38.6  percent  of  the  top  50 
diagnoses  while  ‘S*  codes  that  were  developed  for  the  ACDB  accounted  for  another  1  percent. 

*V”  codes  which  ranked  among  the  top  10  diagnoses  were: 

•  Person  with  feared  complaint  in  whom  no  diagnosis  was  made  (V65.5) 

•  Routine  general  medical  exjimination  at  a  health  care  facility  (V70.00 

•  Exam  well  woman  (V72.31) 

•  Supervision  of  normal  pregnancy  (V22) 
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The  cumulative  percent  may  not  agree  with  the  sum  of  the  percent  shown  due  to  rounding. 


DIAGNOSIS  .  CUMULATIVE  CUMULATIVE 

CODE  DIAGNOSIS  DESCRIPTION  ^  FREQUENCY  PERCENT  FREQUENCY  PERCENT 
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The  medical  diagnoses  among  the  top  10  diagnoses  were; 

•  Acute  pharyngitis  (460.2) 

•  Pain  in  limb  (729.5) 

•  Essential  hypertension  (401) 

•  Suppurative  and  unspecified  otitis  media  (382.0) 

•  Sprains  and  strains,  ankle  (845.0) 

•  Acute  nasopharyngitis  (460) 

As  was  the  case  for  the  USTF,  aside  from  essential  hypertension,  the  medical  diagnoses  were  for  acute 
conditions. 

Case-mix  differences  among  the  six  ACDB  facilities  are  shown  in  Exhibit  V-5.  The  following  five  diagnoses  were 
among  the  top  five  in  at  least  four  of  the  six  reporting  facilities; 

•  Person  with  feared  complaint  (V65.5) 

•  Pregnancy,  normal  (V22) 

•  Hypertension,  essential  (401) 

•  Upper  respiratory  infection,  acute  (460.2) 

•  Exam,  medical  (V70.0) 

The  diagnosis  ’person  with  feared  complaint”  (V653)  was  ranked  highest  in  five  of  the  six  ACDB  facilities. 
"Normal  pregnancy”  (V22)  was  ranked  second  in  half  of  the  facilities.  Overall,  there  appears  to  be  much  more 
consistency  between  ACDB  facilities  in  terms  of  diagnoses.  As  noted  previously,  "person  with  feared  complaint" 
is  probably  bemg  used  as  a  catchall  code  for  when  a  precise  diagnosis  b  not  readily  obtainable. 

2.  ANALYSIS  OF  PROCEDURAL  CASE  MIX 

The  types  of  services  provided  m  an  ambulatory  vbit  are  both  a  direct  reflection  of  resource  intensity  and,  to 
some  degree,  an  indicator  of  illness  severity.  As  such,  they  represent  another  important  element  of  health 
resourcing  activities. 

(1)  Uniformed  Services  TVeatment  Facilities  (USTF)  Data  Base 

As  shown  in  Exhibit  V-6,  the  first  25  procedure  codes  accounted  for  69  percent  of  all  initial  codes.  The 
dbtribution  was  extremely  skewed,  with  50  percent  of  the  procedure  codes  represented  by  the  following  six  codes; 

•  DOD  clinic  visit  (995(X)) 

•  Supplies  provided  (99070) 

•  Establbhed  patient  intermediate  service  (90060) 
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NUMBER  AND  PERCENT  DISTRIBUTION  Of 
TWENTY  FIVE  MOST  COMMON  PROCEDURES 
UNIFORMED  SERVICES  TREATMENT  FACILITIES 


•  Unknown  (00000) 

•  Established  patient  limited  service  (900S0) 

•  Established  patient  extended  service  (90070) 

Within  the  top  2S  procedures,  36  percent  were  categorized  under  ’office  and  other  outpatient  medical  services.’ 
The  second  most  frequently  coded  procedure  is  code  99070,  which  is  defmed  as: 

Supplies  and  materials  (except  spectacles),  provided  by  the  physician  over  and  above  those 
usually  included  with  the  office  visit  or  other  services  rendered  (list  drugs,  trays,  supplies,  or 
materials  provided). 

Most  of  the  other  procedures  relate  to  ancillary  services  provided  during  the  course  of  a  typical  office  visit  such 
as  blood  testing,  urinalysis,  and  radiological  exams. 

Exhibit  V-7  shows  the  five  most  frequently  reported  procedures  by  facility.  It  is  not  surprismg  that  ’old  patient, 
intermediate’  places  within  the  top  five  procedures  code  at  most  of  the  facilities  and  is  first  in  ranking  at  Boston, 
Port  Arthur,  and  Galveston.  At  Nassau  Bay  and  Houston,  "DOD  Clinic  Visit’,  which  is  a  special  USTF  code, 
is  the  most  frequently  reported  code,  while  at  Seattle  and  Portland,  ’Supplies  Provided’,  is  the  most  common 
code,  and  at  Baltimore,  ’00000”,  which  is  an  unknown  code,  is  the  most  common. 

(2)  Civilian  Health  and  Medical  Program  of  the  Uniformed  Services  (CHAMPUS) 

The  25  of  the  most  common  primary  procedures  provided  to  CHAMPUS  beneficiaries  are  summarized  in 
Exhibit  V-8.  Six  of  the  top  25  procedures  are  represented  by  special  CHAMPUS  codes  that  generally  relate  to 
charges  and  purchases  and  are,  thus,  not  normally  associated  with  the  provision  of  a  health  care  service.  The 
first  four  procedures  accounted  for  25  percent  of  all  procedures  on  this  list.  One  of  these  codes  represents  a 
charge  for  ancillary  services  (99088).  Two  relate  to  a  standard  office  visit  with  an  established  patient  (90050  and 
90060)  and  one  relates  to  psychiatric  services  (90844).  Seven  of  the  top  25  procedures  relate  to  routine  office 
care. 

The  types  of  services  featured  among  the  top  25  are  more  comparable  to  the  USTF  data  base  than  to  the  ACDB, 
reflecting  the  needs  of  a  population  that  are  more  chronically  ill  and  somewhat  older  than  the  active  duty  military 
population. 

(3)  U.S.  Army  Ambulatory  Care  Data  Base  (ACDB) 

The  first  25  procedure  codes  (see  Exhibit  V-9)  accounted  for  54  percent  of  all  the  initial  codes.  The  procedure 
codes  are  much  more  evenly  distributed  than  was  observed  for  the  USTF  data  base.  Nine  procedures  accounted 
for  25  percent  of  the  reported  codes  as  follows: 

•  Exam,  general  medical  (90024) 

•  Exam,  complaint  specific  medical  (90009) 

•  Antepartum  care  only  (59420) 

•  Nurse-patient  counseling  (99157) 

•  Exam,  eye,  comprehensive  (92004) 
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•  Exam,  peivic/pap  smear  (90025) 

•  Exam,  pelvic  (90032) 

•  Range  of  motion  measurements  and  report  (9S851) 

•  Exam,  breast  (90013) 

Four  of  the  nine  procedures  relate  specifically  to  women. 

Overall,  types  of  reported  procedures  are  much  more  specific  than  those  offered  in  USTF  data  base.  None  of 
the  initial  25  codes  could  be  classified  as  "office  and  other  outpatient  medical  services". 

The  top  five  procedures  are  shown  by  facility  in  Exhibit  V-10.  The  procedure  "exam,  general  medical"  (90024) 
is  the  highest  ranked  in  four  out  of  six  facilities  and  falls  within  the  top  five  in  all  six.  The  only  other  procedure 
that  falls  within  the  top  five  in  all  six  facilities  is  "exam,  complaint,  special  medical"  (90009).  Four 
procedures  ranked  within  Exhibit  V-10  do  not  appear  among  the  top  25  procedure  shown  in  Exhibit  V-9. 
procedures  are  associated  with  single  facilities  and,  thus,  may  represent  some  facility-specific  idiosyncracy. 
procedures  are: 

•  Health  education/counseling,  hearing  conservation  (02001) 

•  Shot  record  review  (90700) 

•  EFMP  assessment  (90765) 

•  Teaching,  other  direct  patient  (99083) 
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3.  ANALYSIS  OF  ILLNESS  EPISODE  DURATIONS 

Two  dimensions  of  time  were  measured  to  determine  the  appropriateness  of  the  data  bases  for  representing 
episodes  of  illness.  These  deliberations  were  limited  to  the  USTF  and  ACDB  data  pending  the  conversion  of 
the  CHAMPUS  data  to  an  encounter-based  file.  The  two  studied  time  dimensions  are  as  follows: 

•  Span  of  Record  Coverage-This  measure  represents  the  total  average  length  in  days  between 
the  first  and  the  last  patient-specific  record  encountered.  This  is  roughly  analogous  to  person- 
days  available  for  study. 

•  Interval  Between  Visits  For  A  Specific  Diagnosis-This  measure  serves  as  a  rough  gauge  of 
continuity  of  care  and  represents  the  average  number  of  days  between  visits  for  a  specific 
diagnosis. 

A  more  thorough  analysis  must  be  made  with  respect  to  specific  diagnoses  before  we  can  be  sure  that  these  data 
bases  are  suitable  for  episodes  of  illness  analysis.  A  long  interval  between  visits  would  suggest  that  the  data  base 
is  of  limited  utility  for  episodes  of  illness  studies. 

The  following  determinations  were  made  with  respect  to  the  two  data  bases  under  study: 

•  USTF-Fifty  percent  of  all  patient  visit  data  showed  spans  of  105  days  or  less.  Only 
approximately  10  percent  of  the  records  had  a  span  of  a  year  or  more.  This  short  time  span 
would  complicate  the  assessment  of  episodes  of  illness  associated  with  chronic  conditions  that 
require  regular  ongoing  monitoring  and  care. 
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U.S.  ARMY  AMBULATORY  CARE  DATA  BASE 


Teaching  (Other  Direct  Patient) 


In  terms  of  intervals  between  visits  for  specific  diagnoses,  the  median  value  was  39.5  days. 
Given  this  interval  and  the  limited  available  time  span,  we  would  generally  have  only  three 
observation  points  per  patient.  Only  five  percent  of  the  visits  involved  a  return  within 
approximately  one  calendar  week.  It  should  be  noted  that  the  interval  analysis  was  based  on 
only  3,568  observations  for  which  data  were  available. 

•  ACDB"Time  spans  for  the  ACDB  were  not  found  to  be  much  longer  than  for  the  USTF.  In 
this  case,  fifty  percent  of  all  patient  visit  data  showed  spans  of  114  days  or  less~slightly  longer 
than  the  USTF.  As  with  the  USTF,  approximately  10  percent  of  the  records  had  a  span  of  a 
year  or  more. 

In  terms  of  intervals  between  visits  for  specific  diagnoses,  the  median  value  was  40  days.  As 
was  observed  for  the  USTF,  this  time  interval  would  permit  only  three  observations  per  patient 
in  a  given  year.  The  ACDB  did  show  proportionately  more  intervals  of  short  duration  than  the 
USTT.  Ten  percent  of  all  return  visits  were  within  a  week  or  less.  This  interval  analysis  was 
based  ou  only  1,714  cases. 

It  should  also  be  reiterated  that  ACDB  results  are  based  on  a  50  percent  sample  of  all  available 
records.  The  inclusion  of  these  additional  data  would  likely  reduce  the  interval  between  visits 
for  specific  diagnoses  and  might,  as  well,  increase  the  observed  span  of  time  between  the  first 
and  last  visits. 

4.  SUMMARY  OF  FINDINGS 

These  preliminary  findings  suggest  that  data  from  all  three  data  bases  exhibit  considerable  face  validity  as 
descriptors  of  case-mix  measured  by  diagnoses  and  by  procedures.  Analyses  of  time  intervals  associated  with 
patient  visits  suggests  that  at  least  two  of  the  data  bases  may  be  deficient  in  characterizing  episodes  of  illness. 

All  three  data  bases  could  be  considered  in  a  state  of  change.  The  CHAMPUS  data  base  has  required  the  most 
manipulation.  At  this  stage,  it  provides  an  accurate  view  of  the  principal  procedures  but  duplicates  diagnoses 
and  thus  may  affect  the  results  for  diagnostic  case-mix.  The  USTF  data  also  need  structural  refinements  to 
represent  an  outpatient  encounter,  but  further  changes  will  not  affect  the  overall  distribution  of  procedures  or 
diagnoses.  Finally,  since  the  ACDB  represents  a  50  percent  sample  of  all  available  observations,  the  case-mix 
results  could  change  if  the  entire  file  was  used. 
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VI.  FEASIBILITV  ASSESSMENT 


This  discussion  addresses  five  issues  that  pertain  to  the  feasibility  of  using  these  data  bases  in  other  study 
activities.  We  have  refrained  from  a  discussion  of  the  CHAMPUS  data  base  since  additional  processing  efforts 
dedicated  to  the  development  of  encounter-based  records  will  help  us  better  assess  the  utility  of  this  data  base. 

1.  SCOPE  OF  THE  DATA 

How  well  do  these  data  bases  provide  the  appropriate  kind  of  patients  and  the  appropriate  type  of  data  to 
support  grouping  and  other  analyses.  Three  dimensions  of  scope  were  considered  for  this  analysis: 

•  Patient  Demographics-It  is  essential  to  be  able  to  describe  patients  by  age  and  sex  since  these 
factors  often  affect  the  severity  of  illness,  prognosis,  and  the  type  and  duration  of  therapy.  Age 
and  sex  are  incorporated  in  both  the  AVG  and  APG  grouping  strategies. 

In  the  multi-faceted  military  health  care  system,  we  need  to  know  more  about  patient  auspices 
to  incorporate  data  into  resource  planning.  Additional  data  elements  include  service  duty  status 
(active  or  other),  military  service  organization  (Army,  Navy,  Marines,  Air  Force),  and  relation 
to  primary  beneficiary  (self,  child  or  spouse). 

•  Health  Care  Encounter-It  is  possible  to  assign  some  AVGs  on  the  basis  of  diagnosis  alone. 
The  ability  to  assign  a  visit  to  a  particular  group  will  benefit  from  additional  data  on  the  types 
of  procedures  provided  in  the  course  of  a  visit-the  more  procedures  the  better.  The  AVG 
methodology  includes  the  capability  of  processing  an  mdefmite  number  of  procedures,  and  it 
will  select  most  significant  procedure  (for  grouping)  from  among  those  provided. 

APGs  benefit  from  additional  information  on  the  content  of  the  health  visit,  including  signs  and 
symptoms,  acuity,  complexity  or  severity,  site,  and  specialty  of  practitioner. 

We  also  need  data  on  time  to  distinguish  between  one  visit  and  another,  usually  the  date  of  the 
visit.  Other  distinguishing  factors  include  provider  (see  below)  and  clinic  identifiers.  These  are 
especially  important  for  efforts  to  defme  episodes  of  illness. 

•  Resource  UUlization-If  the  objective  is  simply  to  group,  then  we  must  track  resource  utilization 
through  the  services  provided.  However,  since  personnel  resourcing  is  a  primary  activity  of  the 
current  procurement,  we  need  to  identify  the  types  of  personnel  engaged  in  specific  encounters, 
types  of  services  provided,  and  effort  expended.  Cost  data  may  also  serve  as  a  useful  proxy  for 
resource  utilization  if  no  other  data  are  available. 

Each  of  these  data  bases  presents  limitations  with  respect  to  scope.  These  limitations  are  as  follows: 

•  The  USTF  Data  Base-Demographic  data  appear  to  be  sufficient.  Data  pertinent  to  the  health 
care  encounter  are  sometimes  dubious.  Diagnoses  were  missing  from  approximately  14.5 
percent  of  the  available  records.  Procedure  codes  appear  to  include  high  proportions  of  fairly 
unspecific  codes.  Resource  data  are  very  constrained.  Specific  provider  types  are  not  readily 
identifiable  and  there  are  no  data  available  on  provider  service  times.  The  only  cost  datum 
relates  to  the  amount  paid  by  other  insurance. 

•  The  CHAMPUS  Data  Base-Demographic  data  are  sufficient.  Data  pertinent  to  the  health  care 
encounter  are  of  high  quality,  although  the  association  of  non-primary  procedures  with  a 
specific  encounter  may  not  always  be  feasible.  Available  resource  data  include  the  amounts 
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billed  and  allowed  for  each  procedure,  but  not  the  provider  time.  Specific  provider  'major 
specialty”  types  are  available,  as  are  general  provider  capacity  categories. 


•  The  Ambulatory  Care  Data  Base  (ACDB)~The  utiUty  of  the  ACDB  is  highly  constrained  by 
the  number  of  variables  that  were  made  available  for  this  project.  As  noted  previously,  only 
a  limited  number  of  data  fields  are  available.  Demographics  are  limited  to  age  and  sex.  In 
terms  of  encounters,  data  are  only  available  for  the  primary  diagnosis  but  do  cover  multiple 
procedures.  Unfortunately,  the  procedure  codes  are  nonstandard  and  will  require  extensive 
revision  before  they  can  be  used  in  ambulatory  care  groupers.  The  availability  of  provider  times 
enhances  the  resource  utilization  component,  but  it  is  impossible  to  identify  the  type  of 
provider. 

2.  DATA  STRUCTURE 

Structural  issues  consider  how  well  the  reporting  units  correspond  to  the  needs  of  other  uses.  Most  other 
planned  uses  relate  primarily  to  encounters  and,  to  some  extent,  to  unduplicated  patients. 

Data  need  to  be  structured  in  such  a  way  as  to  be  useful  for  planned  activities.  Analysis  focuses  on  patients  and 
more  so  on  outpatient  visits/encounters.  Outpatient  visits  are  represented  by  any  documented  encounter  that 
involves  the  following; 

•  Ascertainment  of  symptoms 

•  Observation  of  the  patient 

•  Diagnostic  assessment  of  the  patient 

•  Provision  of  prescribed  treatment 

•  Provision  of  counseling/education 

In  the  military,  this  encounter  can  be  with  any  health  care  practitioner  who  is  credentialed  to  perform  these  tasks, 
regardless  of  education  and  training,  and  who  is  categorized  as  the  principal  provider  of  care. 

There  is  flexibility  regarding  how  outpatient  visits  are  defined.  Thus,  for  example,  a  health  education  session 
on  diabetes  to  a  group  of  patients  that  ends  with  a  finger  stick  could  be  counted  as  one  visit  (for  the  entire 
group)  or  as  a  visit  for  each  participant.  This  flexibility  exists  even  within  branches  of  the  armed  services. 

Ostensibly,  both  the  USTF  data  base  and  the  ACDB  report  on  outpatient  visits.  Our  experience  suggests  that 
in  both  cases,  care  must  be  taken  to  ensure  that  the  data  as  reported  do,  in  fact,  represent  individual  outpatient 
visits.  For  example,  in  both  files,  we  have  observed  multiple  encounters  with  the  same  provider  in  the  same  day. 

Only  one  of  the  data  bases,  the  ACDB,  can  be  said  to  represent  outpatient  encounters  as  its  fundamental  units. 
The  USTF  records  hold  data  segments  that  relate  to  up  to  six  outpatient  visits.  More  than  one  segment, 
however,  may  relate  to  a  single  encounter.  The  CHAMPUS  data  base  represents  the  most  radical  departure 
from  an  encounter  base.  In  CHAMPUS,  the  records  reflect  claims  and,  thus,  relate  more  to  reimbursement  than 
to  outpatient  visits.  Both  the  USTF  and  CHAMPUS  data  bases  will  have  to  be  converted  to  a  true  encounter 
base  to  be  subjected  to  the  case-mix  analysis  software.  Processes  have  been  developed  to  support  this 
conversion. 
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3. 


COMPLETENESS  AND  ACCURACY 


This  represents  the  fundamental  data  quality  issue.  How  much  are  the  data  plagued  with  quality-related  issues 
and  how  much  will  this  affect  the  utility  of  the  data  for  subsequent  activities?  Completeness  and  accuracy  issues 
that  are  associated  with  the  two  target  data  bases  are  as  follows; 

•  The  USTF  Data  Base— A  very  high  percentage  of  records  in  this  data  base,  about  one  in  every 
seven,  was  excluded  for  lack  of  a  valid  diagnosis  code.  Haphazard  coding  of  diagnoses, 
characterized  by  inconsistent  use  of  the  decimal  point,  also  makes  them  difficult  to  interpret. 
Our  analyses  also  indicate  that  19  percent  of  the  procedure  codes  are  invalid. 

•  The  CHAMPUS  Data  Base-Only  standard  diagnosis  codes  were  used  by  CHAMPUS;  however, 
several  non-standard  procedure  codes  were  used.  Six  of  the  25  most  frequently  reported 
procedures  were  based  upon  these  non-standard  codes.  Overall,  this  claims  data  base  extensive 
appears  to  have  high  coding  validity. 

•  The  Ambulatory  Care  Data  Base  (ACDB)-Both  non-standard  diagnosis  and  procedure  codes 
were  used  extensively  in  the  ACDB.  The  extensive  edit  procedures  appear  to  have  supported 
a  high  overall  data  quality. 

4.  TIME  SERIES 

Time  issues  are  reflected  in  several  key  issues.  These  concerns  include; 

•  The  currency  of  the  data 

•  The  periodicity  of  data  collection  (ongoing  or  one-shot) 

•  The  period  covered 

•  The  ability  of  the  data  to  reflect  the  course  of  care  for  particular  patients  in  a  given  period 
The  following  discussion  relates  these  issues  to  the  two  target  data  bases; 

•  The  USTF  Data  Base-The  USTF  represents  an  ongoing  data  collection  effort.  The  current 
data  base  includes  records  through  December  31,  1988.  Data  for  1989  have  just  become 
available.  The  typical  patient  has  records  that  span  a  105  day  period.  The  time  between  visits 
for  a  specific  diagnosis  is  typically  about  40  days.  Thus,  the  typical  patient  will  probably  have 
three  encounter  records  for  any  given  diagnosis  that  requires  ongoing  care. 

•  The  Ambulatoiy  Care  Data  Base  (ACDB)— The  ACDB  represents  a  one-shot  data  collection 
effort.  Data  collection  occurred  continuously  over  the  period  1985  to  1987.  The  typical  ACDB 
patient  has  records  that  cover  a  114  day  period.  The  median  time  between  visits  for  a  specific 
diagnosis  was  also  40  days,  gelding  three  encounter  records  for  any  given  diagnosis  for  a  typical 
patient  who  requires  ongoing  care. 

5.  RELEVANCE  TO  THE  MILITARY 

Relevance  relates  to  how  well  the  data  represent  the  type  of  care  provided  at  military  treatment  facilities,  and 
how  sensitive  the  data  bases  are  to  the  unique  properties  of  the  military  health  care  system,  such  as  the 
predominance  of  nonphysidan  health  care  providers? 
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Ostensibly,  the  ACDB  should  be  superior  to  the  USTF  in  terms  of  its  relevance  to  the  military.  It  is  the  only 
data  base  that  relies  on  actual  U.S.  Army  Medical  Treatment  Facilities  (MTFs).  Further,  the  data  seem  to 
reflect  those  diagnoses  and  procedures  common  to  U.S.  Army  MTFs.  For  example,  a  review  of  the  top  50 
percent  of  the  diagnoses  and  procedures  revealed  results  common  to  a  young  population  with  young  families  and 
a  rigorous  physical  training  program.  This  was  supported  by  the  high  percentage  of  diagnoses  for  acute 
orthopedic  problems,  pregnancies,  and  child-related  problems.  The  absence  of  key  fields  as  well  as  its  one-shot 
nature  diminishes  the  superiority  of  this  data  base. 
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CHAPTER  VII 


RECOMMENDED  USES  FOR  THE  DATA  BASES 


VII.  RECOMMENDED  USES  FOR  THE  DATA  BASES 


This  analysis  suggests  that  all  data  bases  have  their  limitations.  Our  ultimate  concern  is  how  well  these  data 
bases  will  support  the  three  prime  applications; 

•  Ambulatory  care  grouping  strategies 

•  Description  of  case-mix  and  service  utilization 

•  Episodes  of  illness 

The  following  discussion  briefly  reports  our  recommendations  with  respect  to  each  of  these  uses. 

1.  AMBULATORY  CARE  GROUPING  STRATEGIES 

In  terms  of  grouping  strategies,  once  we  resolve  the  unknown  diagnostic  codes,  the  USTF  data  base  contains  the 
minimum  required  data  for  AVGs  and  can  be  used  without  much  modification.  The  ACDB  is  a  less  suitable 
vehicle  due  to  the  use  of  nonstandard  diagnostic  and  procedural  codes.  Cross-walks  are  under  development  to 
facilitate  grouping  of  these  data.  Preliminary  reports  on  the  CHAMPUS  data  base  suggest  that  diagnostic  coding 
may  be  inaccurate.  The  utility  of  this  latter  data  base  is  still  being  assessed. 

At  this  point,  none  of  the  data  bases  appear  to  have  sufficient  data  to  support  their  use  with  Ambulatory  Patient 
Groups.  Hopefully,  ongoing  modifications  to  this  grouper  will  reduce  its  imposing  data  burden. 

2.  DESCRIPTION  OF  DIAGNOSTIC  AND  PROCEDURAL  CASE-MIX 

In  this  report,  we  used  all  three  data  bases  to  describe  diagnostic  case-mix  and  service  utilization.  Results  of 
this  effort  seem  reasonable  given  what  we  know  about  the  service  population.  The  ACDB,  which  subsumes  a 
generally  more  active  and  younger  patient  population,  shows  case-mix  patterns  that  reflea  the  problems  of  such 
populations  such  as  pregnancy,  acute  respiratory  illness,  and  sprains  and  strains.  The  greater  age  of  the  USTF 
population  is  refleaed  in  the  relative  importance  of  adult  onset  diabetes.  The  higher  prevalence  of  more  chronic 
and  severe  health  problems  in  the  CHAMPUS  data  base  may  reflea  a  preference  to  use  this  source  for 
nonroutine  health  care. 

Overall,  the  results  for  all  data  bases  exhibit  considerable  face  validity.  CHAMPUS  diagnostic  coding  seems  very 
consistent  with  ICD-9  conventions,  but  a  lot  of  nonstandard  codes  (non-CPT4)  are  used  for  procedures.  The 
ACDB  coding  integrity  appears  better  than  that  of  the  USTF,  but  the  modifications  of  prevailing  coding  practices 
in  this  data  base  will  make  comparisons  with  other  patient  populations  difficult. 

3.  EPISODES  OF  ILLNESS 

Analyses  of  time-related  data  suggest  that  neither  the  ACDB  nor  the  USTF  will  be  particularly  suitable  for  the 
development  of  episodes  of  illness  given  both  the  relatively  small  number  of  continuing  cases  and  the  relatively 
long  time  intervals  between  visits.  Neither  data  base  includes  sufficient  data  to  ascertain  whether  an  episode  of 
illness  has  truly  ended  or  is  simply  not  reflected  in  intervening  visits.  Both  files  do  have  provision  for  the 
reporting  of  multiple  diagnoses.  Of  the  two  diagnostic  fields  available  in  the  ACDB,  only  one  was  provided  in 
our  version  of  this  flle.  Further,  the  utility  of  the  ACDB  for  this  type  of  analysis  is  also  hampered  by  the  fact 
that  the  available  data  base  is  only  a  50  percent  sample  of  the  available  cleaned  data. 
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Preliminary  evidence  with  respect  to  CHAMPUS  suggests  that  this  data  base  will  al*  be  a  poor  source  for  the 
development  of  illness  episodes.  Dates  <u'e  frequently  missing  from  the  records  ai.  .  nisodc*  billing  appears 
to  be  erratic. 

Efforts  to  develop  episodes  of  illness  based  on  these  data  require  further  developmental  stages.  The  next  effort 
should  be  an  assessment  of  the  utility  of  the  data  with  respect  to  specific  diagnoses.  As  suggested  by  Dr.  Joanna 
Lion,  one  of  the  developers  of  the  AVGs,  the  following  diagnoses  appear  appropriate  for  an  initial  effort: 

•  Otitis  media 

•  Anxiety/Depression 

•  Karpal  tunnel  syndrome 

•  Vasectomy 

•  Diabetes 

•  Bronchoscopy 

As  is  often  the  case  with  analyses  of  this  sort,  the  deeper  we  investigate  the  issues,  the  more  complex  these  issues 
become. 
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ENDNOTES 


J.  M.  Georgoulakis,  J.  P.  Moon,  et  al.  The  Army  Ambulatory  Care  Data  Base  ( ACDB)  Study: 
Implemeutatioo  And  Preliminary  Data.  Office  of  the  Assistant  Secretary  of  Defense  for 
Health  Affairs.  Report  No.  HR  88-002B.  September,  1988.  p.  39. 


I  APPENDIX  A 

MEMORANDA  ASSOCIATED  WITH  OBTAINING  ACCESS  TO  THE  USTF  AND  ACDB 


OFFICE  OF  THE  ASSISTANT  SECRETARY  OF  DEFENSE 


HEALTH  AFFAIRS 
(HEALTH  MANAGEMENT  SVSTEMSI 


WASHINGTON.  D.C.  20301-1200 


30  March  1990 


MEMORANDUM  FOR  DM IS  PROJECT  OFFICER 

SUBJECT:  Release  of  Uniformed  Services  Treatment  Facilities 

Clinical  Data  for  CY  1988  and  CY  1989 


The  Comprehensive  Health  Care  Management  (CHCM) 

Demonstration  Project  has  designated  a  portion  of  technology 
development  to  the  aimbulatory  arena.  In  so  doing,  we  have  a 
requirement  to  begin  to  analyze  all  available  ambulatory  data 
with  disease  and  procedure  detail.  The  analysis  will  focus  on 
the  value  of  patient  classification  measures  for  the  Department 
of  Defense  (DoD)  within  the  scope  of  the  CHCM  effort  and  serve 
as  a  source  of  data  helpful  in  the  definition  of  future  data 
recjuirements . 

Request  a  copy  of  the  1988  and  1989  data  from  Uniformed 
Services  Treatment  Facilities  be  submitted  by  data  tape  to  our 
analysis  site'  at  Fort  Detrick,  MD.  As  per  our  earlier 
discussion,  if  the  1989  data  are  not  complete,  from  an  editing 
and  collection  perspective,  a  subsequent  submission  would  be 
acceptable . 

The  work  involves  analysis  of  a  series  of  ambulatory  data 
bases  supported  by  a  CAAS  contract  study  to  develop  an 
application  of  Ambulatory  Visit  Groups  (AVGs)  for  DoD.  As  you 
know,  the  Department  was  directed  by  Public  Law  101-189  to 
incorporate  the  ambulatory  equivalent  of  Diagnosis  Related 
Groups  in  our  resourcing  model(s)  for  the  Military  Health 
Services  System  by  1  October  1991. 

The  tasks  to  be  executed  in  this  contract  are  aimed  at 
evaluation  of  outpatient  morbidity  trends  as  depicted  by  coding 
systems  such  as  ICD-9-CM  and  CPT-4  and  subsequently  used  in 
patient  classification  systems  such  as  AVGs.  A  major  portion  of 
the  work  will  be  to  test  the  statistical  and  clinical  adequacy 
of  AVG  modifications  currently  in  progress  through  our  Health 
Care  Financing  Administration — Brandeis  contract  determining 
useful  modifications  for  the  Version  2.0  AVG  Grouper. 


The  results  of  this  project  will  hopefully  advance  the 
Department's  capability  to  direct  change  in  the  ambulatory 
setting  both  in  terms  of  developing  health  policy  options  and 
evolving  information  systems  design. 

The  complete  mailing  address  for  the  data  tapes  is: 

USAISC-Ft  Detrick 

Attention:  ASNE-HD  (Mr.  David  Bolling) 

Building  1422 

Ft.  Detrick,  MD  21701-5016 


Deputy  Director,  Resource  Analysis 
and  Management  Systems 


Copy  to : 

COL  Milton  Turner 
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OFFICE  OF  THE  ASSISTANT  SECRETARY  OF  DEFENSE 
WASHINGTON,  D.  C.  20301-1200 


HEALTH  AFFAIRS 


1  4  JUN  1990 


MEMORANDUM  FOR  COMMANDER,  U.S.  ARMY  HEALTH  CARE  STUDIES  AND 

CLINICAL  INVESTIGATION  ACTIVITY 
THROUGH:  OFFICE  OF  THE  SURGEON  GENERAL  OF  THE 
ARMY  (DASG-RMZ) 

SUBJECT:  Request  for  Access  to  Ambulatory  Database 


As  previously  agreed  upon  between  representatives  of  our 
respective  offices,  request  on-line  access  to  data  in  Sample  1 
of  the  U.S.  Army  Ambulatory  Care  Data  Base  (ACDB) .  This  data 
will  be  used  to  design  the  Department’s  ambulatory  systems 
requirements  and  develop  an  ambulatory  resource  and  manpower 
modeling  capability. 

Our  analysis  may  require  clarification  of  data  elements  and 
related  data  administration  issues.  As  such  occasions  arise,  we 
look  forward  to  the  opportunity  to  coordinate  questions  and 
early  results  with  members  of  the  U.S.  Army  Health  Care  Studies 
staff . 

Request  a  copy  of  Sample  1  fields  1-70  as  listed  in  the  ACDB 
Data  Dictionary  Sequential  Files  of  Phase  I,  Report  M  HR90-001, 
dated  1  November  1989. 

Your  assistance  in  helping  the  Department  evolve  its 
ambulatory  data  requirements  and  modeling  efforts  is  greatly 
appreciated.  My  points  of  contact  on  this  matter  are 
LTC  Stuart  W.  Baker,  Resource  Analysis  and  Management  Systems 
and  LCDR  Mike  Saxinders,  Joint  Manpower  Office. 


Deputy  Assistant  Secretary  of  Defense 
(Health  Services  Operations) 


DEPARTMENT  OF  THE  ARMY 

U.S.  ARMY  HEALTH  CARE  STUDIES  AND  CLINICAL  INVESTIGATION  ACTIVITY 
FORT  SAM  HOUSTON.  TEXAS  7B234-6060 


HSHN-H  (5-5) 


23  July  1990 


MEMORANDUM  THRU 

Commander,  U.S.  Army  Health  Services  Command,  Fort  Sam  Houston, 
TX  78234-6000 

HQDA  (DASG-PSZ/BG  Scotti),  5109  Leesburg  Pike,  Falls  Church, 

VA  22041-3258 

FOR  Deputy  Assistant  Secretary  of  Defense  (Health  Services 

Operations),  ATTN:  RADM  Harold  M.  Koenig,  MC ,  USN,  HSO, 
Room  3E336,  The  Pentagon,  Washington,  DC  20350-2000 

SUBJECT:  Request  for  Army  Ambulatory  Care  Information 


1.  Reference  memorandum,  OASD(HA),  14  Jun  90,  subject:  Request 
for  Access  to  Ambulatory  Database. 


2.  In  accordance  with  the  agreement  between  representatives  of 
the  U.S.  Army  Health  Care  Studies  and  Clinical  Investigation 
Activity  (HCSCIA)  and  the  Office  of  the  Assistant  Secretary  of 
Defense  (Health  Affairs),  Health  Services  Operations  Division, 
data  from  the  Army's  Ambulatory  Care  Data  Base  Study  (ACDB)  will 
be  transmitted  to  Fort  Detrick  for  use  by  Health  Services 
Operations  personnel.  The  data  file  will  consist  of  data  from 
Sample  1.  More  specifically,  it  will  include  all  patient  visits 
from  Sample  1  with  the  following  variables:  age,  gender, 
diagnosis,  procedures,  visit  time,  provider  ID,  and  site  ID. 


5.  As  discussed  in  a  meeting  with  Colonel  Turner,  Director  of 
Health  Systems  Planning,  Policy  and  Architecture,  on  15  May  1990, 
all  data  in  these  fields  have  not  been  verified.  However, 
members  of  HCSCIA  activity  staff  will  be  available  for 
assistance,  if  needed. 

4.  Members  of  the  HCSCIA  staff  look  forward  to  assisting  you  in 
your  endeavors. 


